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(54) Apparatus and method lor analyzing acquired scan data 



(57) The invention refers to an apparatus and a 
method for analyzing and visualizing acquired physio- 
logical scan data. A display is used to visualize the ac- 
quired data and in addition to that the initial calibration 
setting can be done with sliders which are shown on the 
display. The apparatus is partitioned in a first subsystem 
a second subsystem. The second subsystem comprises 
a processing unit receiving the signals accumulated by 



the at least two detectors of the first subsystem. The 
seconds subsystem is used as well for calculating polar 
coordinates of the signals acquired by the first and sec- 
ond detectors. A unit for quantizing the angle compo- 
nent of the polar coordinates and adjusting the informa- 
tion capacity to the available display and a visualization 
unit for assigning color to the values measured are im- 
plemented in the second subsystem as well. 
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physiological scan data and thereby improving the measurement results and the optimizing the visualization of the 
scan data and in addition to that allow a reduction in production costs. 

[0008] This object is solved by an apparatus for analyzing and visualizing acquired physiological scan data, the 
apparatus comprises: a display; a first subsystem wherein the first subsystem comprises at least two detectors each 
responsive to a different wavelength; a second subsystem comprising a processing unit receiving the signals accumu- 
lated by the at least two detectors and calculating polar coordinates for the signals acquired by the first and second 
detectors; a unit for quantizing the angle component of the polar coordinates and adjusting the information capacity to 
the available display; and a visualization unit for assigning color to the values measured. 

[0009] It is another object of the present invention to provide a method for analyzing and visualizing acquired phys- 
iological scan data. The method improves the measurement result and optimizes the visualization of the scan data. 
[0010] This object is solved by a method which comprises the steps of: 

• accumulating scan data for at least two different wavelengths each wavelength is accumulated with a different 
detector, 

• transferring the accumulated data to a processing unit for calculating polar coordinates of the accumulated scan 
data 

• quantizing the angle component of the polar coordinates and sending the data to a visualization unit, 

• assigning color to angle components of the scan data for generating colored angle components, and 

• displaying the colored angle components on a display. 



[0011] It is a further object of the present invention to provide a scanning fluorescence microscope. The scanning 
fluorescence microscope analyzes and visualizes the acquired physiological scan data and thereby improves the meas- 
urement results and optimizes the visualization of the scan data and in addition to that allow a reduction in production 
costs. 

[001 2] The object is accomplished by a scanning fluorescence microscope with means for analyzing and visualizing 
acquired physiological scan data, comprising: 



a first subsystem wherein the first subsystem comprises at least two detectors each responsive to a different 



a second subsystem comprising a processing unit receiving the signals accumulated by the at least two detectors 
and calculating polar coordinates for the signals acquired by the first and second detectors; 
a unit for quantizing the angle component of the polar coordinates and adjusting the information capacity to the 
available display; and 

a visualization unit for assigning color to the values measured. 

[0013] It is yet another object of the present invention to provide a method for analyzing acquired scan data wherein 
the scan data are acquired with a scanning fluorescence microscope. The measurement results and the visualization 
of the measurement results should be optimized. 

This object is accomplished by a method for analyzing and visualizing acquired physiological scan data comprising 
the steps of: 

• providing a scanning fluorescence microscope having at least two detectors each of which acquire light which 
differs in wavelength, 

• scanning a fine light beam generated by an Illumination means for across a sample of Interest, 

• accumulating scan data for at least two different wavelengths each wavelength is accumulated with a different 
detector, 

• transferring the accumulated data to a processing unit for calculating polar coordinates of the accumulated scan 
data 

• quantizing the angle component of the polar coordinates and sending the data to a visualization unit, 

• assigning color to angle components of the scan data for generating colored angle components, and 

• displaying the colored angle components on a display. 

In the preferred embodiment of the invention an apparatus for analyzing and visualizing acquired physiological scan 
data is disclosed. The configuration according to the present invention provides the advantage that in the context of 
the transformation, a separation is performed between the usable signal and the interference signal. This considerably 
simplifies the configuration of the apparatus, resulting in lower manufacturing costs. What is significant in this context 
is that after the transformation, only scalar variables are processed. The transformation maps the original two-dimen- 
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Equation 2 shows the ratio rasa function of a vector" co that results from dividing first signal A, by second signal / 2 . 



5 r(/) = — (Equation 2) 

It is apparent that all the n ?i=.v>.,.« in the l,-l 2 diagram (see FIG. 3) define a straight line s t = s^. Each process 
w that brings about a change in the ratio r must be associated with a change A/ in the first and second signals equivalent to 

A/. 

AI = ( ) (Equation 3) 

A/, 

in which A/, , and A/ 2 represent the changes in the first and second signals A, , l z respectively. This change At can be 
separated into two directions: in a direction parallel to g, no change in the ratio can occur; in a direction perpendicular 
to the straight line g (corresponding to Vr), a maximal change in the ratio occurs. Since this applies equally to all points, 
it is an obvious step to expand into polar coordinates as shown in Equation 4, in which R indicates the radius and 9 
20 the angle for representing the first and second signals A,, and l 2 in polar coordinates: 



arctan( y. ) 



[ R ) 

^arctan(r) J 



(Equation 4) 



As is evident from Equation 4, only angle <p contains the relevant information. In a scanning microscope (e.g. in a 
confocal microscope), the signals A, and l 2 deriving from first and second detectors 1 2 and 14 are necessarily discrete. 
30 in the simple case in which both variables are quantized in identical fashion in Q steps, the result is Q 2 distinguishable 
steps for the ratio signal. If identical probabilities are assigned to these steps, the number of bits shown in Equation 5 
is needed in order to code the ratio. 



B ratio = W( O 2 ) bits = 21d ( Q) bits (Equation 5) 



This corresponds to a doubling of the memory space as compared to the two acquired variables (first and second 
signals and ^). Coding of the angleo is determined by the number of vectors 7 that can be resolved on a circle of 
radius R for an angle <p from 0° to 90°. Assuming that R: <j> < R 20 is constant, an upper limit of states can be 
40 indicated on the discrete space for each radius. This upper limit is defined by the length of the circular segment in 
Equation 6: 

Q R = ^ (Equation 6) 



Q R is an upper bound for this value. This is an overestimate of states along oblique sections. This property is typical 
of discrete topologies. The maximum for this upper limit Q Ramlt is obtained, for R = V20, from Equation 7: 



so n _ xJ2q 

^R.lirrit 2 — 



Coding the states of this path (assuming an equal probability for all states) then requires a quantity B B of bit states 
(Equation 8): 

55 
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digital neural network. 

Signal separation (physiological and non-physiological) 

[0024] The separation of physiological signals from non-physiological interference can also be applied here. The 
formulas presented in the documentation of C. R. Bright et al.. Methods in Cell Biology, Vol, 30, pages 157 to 192, 
Academic Press Inc., for the calibration of physiological signals are all based on titration experiments. The in vitro 
calibration using Cations is reproduced by Equation 12, the pH value by Equation 13, and cAMPby Equation 14: 

[Ca 2+ ] = Kp^. (Equation 1 2) 



[ pH]~\og r -^- r (Equation 1 3) 



[cAMP] = K(!^™) Vn (Equation 1 4) 

max"' 

in which r min is the measured ratio without calcium ions and r max the measured ratio with the maximum concentration 
of calcium ions. All the underlying processes are delimited by one r min and one r max . When measuring r min and r max 
with fluorescent dyes, consideration must also be given to unbound and saturation states, meaning that in one case 
a maximum first signal /, is received and in the other case a maximum second signal l 2 These values must necessarily 
be measured with the same detectors, and are absolute operating limits. In l r l 2 diagram 24 (cf. FIG. 3), this information 
can be used to define a working region (in this case ignoring any background fluorescence, which essentially causes 
a displacement of the origin), within which a physiological signal must remain. White region 20 marked in l r l 2 diagram 
24 is referred to as the "permitted region." Region 22 marked with crosshatching is of no physiological origin, and is 
not utilized for measurement. Any measurement point that is received in the hatched region is unequivocally a meas- 
urement error. This can be used to validate the measurement results. One possibility is to assign a specific color to 
not useable measurement results (for example by coloring points in the image red). In addition, this delimitation could 
also be used to reduce memory even further (although this is not discussed further here). The oblique operating bound- 
aries can advantageously be verified in the transformation space that is described (boundary angles), and saturation 
intensities can be verified in the non-transformed space. Here again, an implementation in analog electronics, digital 
electronics, or software are possible. The segmented signal can be visualized directly; in an image, for example, all 
physiological components can be coded green, and all invalid components red. 

Calibration and validation of physiological phenomena: 

[0025] White region 20 depicted in FIG. 3 is the aforementioned working region, which is of high quality when it 
possesses the greatest possible opening angle and the largest possible surface area in t r t 2 diagram 24. This quality 
criterion can easily be verified, and is particularly favorable for use in an automated system adjustment method. One 
example is definition of the external comer points while at the same time displaying the plane in a derived form. 
FIG. 4 shows a configuration that is suitable for visualizing the aforementioned criteria. First and second signals /, and 
/ 2 are delivered to control and processing unit 16. Also provided upstream from control and processing unit 16 are a 
first and a second branch 30 and 32, which convey first and second signals l 1 and l 2 to first and second comparison 
elements 34 and 36, respectively. Angle coordinate <p of the polar coordinate of the particular measurement point is 
similarly conveyed to a third comparison element 38, which defines the lower limits of angle coordinate 9. Angle co- 
ordinate <p is additionally conveyed to a fourth comparison element 40, which defines the upper limits of angle coordinate 
9. Each of the comparison elements possesses an output 34a, 36b, 38a, and 40a, through which the signals are sent 
to a validation unit 42. The corresponding signals are sent from validation unit 42 out to display 18, and presented to 
the user in visual form. 

[0026] FIG. 5 shows a schematic depiction of the invention which illustrates the correlation among the individual sub 
processes. The data to be processed are sent to a first section 50. The data derive, for example, from a corresponding 
receiving unit 50a. As described above, the data possess a particular coding of the amplitudes of signal pairs. This is 
a transformation of the amplitude vectors followed by quantization (see description of FIG. 2). The result of the trans- 
formation is to separate the usable signal and interference signal. This simplifies the system design and results in lower 
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70. The color information is adapted to the expected measured values. The algorithms implemented in visualization 
unit 75 are not specified further here. All algorithms profit from the improved signal dynamics that can be achieved 
with control and processing unit 16. For image data., accumulation or filters (for "attractiveness" purposes) could be 
integrated. For volumetric data (for example in confocal microscopy), there could be a volume Tenderer. 
[0033] FIG. 7 shows one possible presentation of the data on display 1 8 after segmentation. The segmentation model 
of itself, however, can be visualized by way of a geometric analogy and presented to the user. This can be done with 
a presentation as in FIG. 7, similar to a cytofluorogram. First signal /, is plotted on the ordinate, and second signal l 2 
on the abscissa. The individual measurement points are depicted as a cloud between the coordinate axes. What is 
depicted is the /,-/ 2 space as in FIG. 3, together with frequency information indicating how often each particular com- 
bination of the first and second signals (/, und l 2 ) occurs in an image. This space can also be used to visualize the 
segmentation polygon. 

[0034] FIG. 8 shows an exemplary embodiment for adjusting a segmentation polygon 80 on display 1 8. The simplest 
form of calibration has an input mask for r min , r max , l min l max . The gain and zero point are set by way of the system 
(generally using a panel box or slider, which is depicted correspondingly on the screen). A corner 82 of segmentation 
polygon 80 located opposite the coordinate origin can be adjusted using a first slider 84 on the abscissa and a second 
slider 86 on the ordinate. A third slider 88 on the abscissa and a fourth slider 87 on the ordinate make it possible to 
adjust the upper limit / r ^na X of first signal / n and the upper limit l 2 - max of second signal fe. All the values can be read off 
directly from a diagram of this kind. At the same time, it is possible in this fashion to determine the quality of the 
measurement, which depends on the surface area of polygon 80. In addition, as in the case of a cytofluorogram, the 
image information can also be presented as a point cloud and the outliers-those points lying outside polygon 80-are 
directly visible. This information can be used accordingly for calibration. This is done by displaying the image and the 
diagram (FIG. 8) side by side on display 18. The average intensities in this polygon 80 yield the sharp comer of the 
polygon close to the origin of the coordinate system. The cell of interest could also be delimited by a polygon 80 in the 
image. The averaged intensities inside this polygon correspond to a second point. 

[0035] FIGS. 9a through 9h are a graphic depiction of the calibration procedure for determining the polygon. FIG. 
9a shows the first step in calibration. In diagram 90, a background region H is defined. A region of interest F represents, 
for example, the cell being examined or the cell of interest. The polygon can then be constructed sequentially using 
these two regions (or points) H and F. 

[0036] As shown in FIG. 9b, images are continuously received and the user adjusts the zero points of first and second 
detectors 12 and 14 until background region H is located in the vicinity of origin 92. Background region H (bounded by 
a dashed line in FIG. 9b) then migrates toward the origin as indicated by arrow 91 . 

[0037] The ion of interest in the specimen is bound by chemical intervention. As FIG. 9c shows, region of interest F 
migrates as indicated by an arrow 93. Region of interest F achieves an increased intensity in diagram 90. The chemical 
intervention is done for example by pouring a solution of the ion of interest onto the sample. 

[0038] In FIG. 9d, the gain of first detector 12 is adjusted so as to reach almost the end of the detector sensitivity/ 
resolution. Region of interest F moves in the direction of an arrow 94 away from the abscissa of diagram 90. 
[0039] As is evident from FIG. 9e, from the positions of the background region H and region of interest F it is already 
possible to define a first and a second line 95 and 96 of the segmentation polygon. First line 95 connects the background 
region H and the region of interest F, and second line 96 passes through region of interest F and runs parallel to the 
abscissa of diagram 90. 

[0040] In FIG. 9f the ion of interest is now released by intervention. The region of interest F migrates in the direction 
of an arrow 97 away from the intersection of first and second lines 95 and 96. The intersection is identified by a dotted 
box. 

[0041] In FIG. 9g, the gain of second detector 14 is adjusted so as to reach almost the end of the detector sensitivity/ 
resolution. The region of interest F migrates in the direction of an arrow 98 parallel to the abscissa of diagram 90. 
[0042] As is evident from FIG. 9h, the final position of region of interest F allows a third and fourth line 99 and 100 
to be defined. Third line 99 connects the background region H and region of interest F. The fourth line passes through 
region of interest F and is parallel to the ordinate of diagram 90. This algorithm maximizes the surface area of the 
resulting polygon, can serve as an explanatory component, and encompasses almost all the calibration parameters. 
These can subsequently be saved and reused when necessary (similar cells, similar environment). The steps described 
in FIGS. 9b, 9d, 9e, 9g, and 9h can be performed automatically. Each step in itself is relatively simple. The steps 
described in FIGS. 9d and 9g can be performed either by directly modifying the gain on the panel box or also by 
dragging region of interest F on display 1 8. 

[0043] Although specific embodiments have been illustrated and described herein, it will be appreciated by those 
skilled in the art that any arrangement which is calculated to achieve the same purpose may be substituted for the 
specific embodiment shown. This application is intended to cover any adaptations or variations of the present invention. 
Therefore, it is manifestly intended that this invention be limited only by the following claims. 
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2s Claims 

1. Apparatus for analyzing and visualizing acquired physiological scan data, comprising: 

a display (1 8); 

30 a first subsystem (60) wherein the first subsystem (60) comprises at least two detectors (12,1 4).each respon- 

sive to a different wavelength; 

a second subsystem (61) comprising a processing unit (16) receiving the signals accumulated by the at least 
two detectors (12 and 14) and calculating polar coordinates for the signals acquired by the first and second 
detectors (12 and 14); 

35 a unit for quantizing (70) the angle component of the polar coordinates and adjusting the information capacity 

to the available display (1 8); and 

a visualization unit (75) for assigning color to the values measured. 

2. Apparatus as defined in claim 1 wherein the second subsystem (61) comprises a segmenter (72) which has a 
40 plurality of input ports for receiving the detector signals and angle component, and inputs for calibration parameters 

consisting essentially of minimum angle, the maximum angle, maximum and minimum intensities from the detec- 
tors, and a visualization unit (75) for assigning one color to proper measurement values and an other color to 
improper measurement values. 

*9 3. Apparatus as defined in claim 1 wherein a storage unit (71 ) is provided for storing the quantized angle component 
of the polar coordinates. 

4. Apparatus as defined in claim 2 wherein the processing unit (1 6) has a second output (68) forthe radius component 
of the polar coordinate which is sent to a second quantizer (69) and the output of the second quantizer (69) is sent 

so to the visualization unit (75). 

5. Apparatus as defined in any one of the claims 1 to 4 wherein a scanning fluorescence microscope has the apparatus 
implemented. 

ss 6. Method for analyzing and visualizing acquired physiological scan data comprises the steps of: 

• accumulating scan data for at least two different wavelengths each wavelength is accumulated with a different 
detector (12 and 14). 
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Fig. 9h 
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(54) Apparatus and method for analyzing acquired scan data 



(57) The invention refers to an apparatus and a 
method for analyzing and visualizing acquired physio- 
logical scan data. A display is used to visualize the ac- 
quired data and in addition to that the initial calibration 
setting can be done with sliders which are shown on the 
display. The apparatus is partitioned in a first subsystem 
a second subsystem . The second subsystem comprises 
a processing unit receiving the signals accumulated by 



the at least two detectors of the first subsystem. The 
seconds subsystem is used as well for calculating polar 
coordinates of the signals acquired by the first and sec- 
ond detectors. A unit for quantizing the angle compo- 
nent of the polar coordinates and adjusting the informa- 
tion capacity to the available display and a visualization 
unit for assigning color to the values measured are im- 
plemented in the second subsystem as well. 
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